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TITLE 

DISTRIBUTED ROUTER FOR DYNAMICALLY MANAGING 
FORWARDING INFORMATION AND METHOD THEREOF 

CLAIM OF PRIORITY 
[0001] This application claims priority under 35 U.S.C. §119 to our application entitled 
DISTRIBUTED ROUTER FOR DYNAMICALLY MANAGING FORWARDING INFORMATION 
AND METHOD THEREOF earlier filed in the Korean Intellectual Property Office on the 30 th day 
of January 2003 and there assigned Serial No. 2003-6435, the contents of which are incorporated 
herein by reference. 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0002] The present invention relates generally to a method of managing forwarding information 
in a distributed router {i.e., in a router constructed with a distributed architecture), and more 
particularly, to a method of sharing in real time routing information collected at each router node 
from among all the router nodes within a distributed router and of dynamically managing 
forwarding information by aggregation based on the routing information. 



Description of the Related Art 
[0003] Along with the development of ultra high-speed, large-capacity networks, routers have 
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1 evolved from existing centralized architecture to new distributed architecture. 

2 [0004] In a centralized router, a central processor implements routing protocols and manages 

3 routing information collected by the routing protocols. For example, the central processor 

4 computes routing tables and distributes to line cards the routing tables that it computes. Hence, 

5 the line cards perform packet forwarding based on the routing tables computed by the central 

6 processor. 

7 [0005] On the other hand, a distributed router allocates the tasks of the central processor among 

8 a plurality of processors, and consequently processes a large volume of data in comparison to a 

9 centralized router. The distributed router has different processors; for example, a first processor 

10 that manages the routing protocols, a second processor that calculates the routing tables, and a 
i i third processor that manages packet forwarding. Each of the processors is dedicated to its assigned 

12 function, thereby endeavoring to improve routing performance. 

1 3 [0006] Routing nodes have their own routing tables to support their sub-networks and their own 

14 processors to process routing paths. From the perspective of users, the routing nodes are seen as 

15 one router, even though these routing nodes each globally manage the routing tables of the other 

16 routing nodes within the distributed architecture of the router. 

1 7 [0007] The input/output processor for each routing node is divided into a system processor area 
i 8 with the routing protocols, a management processor, and a routing table, and a network processor 

19 area with a forwarding table. The system processor for each of the routing nodes performs a set 

20 of operations by collecting the routing information, managing the forwarding table obtained by 

21 calculating a routing path, and sharing the routing table with the other input/output processors, 
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whereas the network processor forwards data between network equipment connected in the local 
area in accordance with the forwarding table. Hence, the distributed router must process a large 
volume of data rapidly. 

[0008] Each of the routing nodes must share its forwarding table with the other routing nodes 
in order to process a large volume of data rapidly in the distributed router. By way of example, 
traditionally, each routing node exchanges the forwarding tables with the other routing nodes so 
that any one of the routing nodes can globally manage the forwarding tables of all of the routing 
nodes. Consequently, each routing node of a distributed architecture router must be equipped with 
a large-capacity memory in order to store the forwarding tables; this creates an unnecessary 
overhead for the main operational utility of routers, namely packet forwarding. 

SUMMARY OF THE INVENTION 
[0009] An object of the present invention is to substantially solve at least the above problems 
and/or disadvantages and to provide at least the advantages below. Accordingly, an object of the 
present invention is to provide a distributed router and process for preventing an increase in inter- 
node traffic caused by packet forwarding attributed to each routing node's sharing of routing 
information with the other routing nodes within a distributed architecture router. 
[0010] Another obj ect of the present invention is to provide a distributed architecture router and 
a process in which each routing node shares in real time its collected routing information with the 
other routing nodes within a distributed architecture router. 

[0011] Still another object of the present invention is to provide a router and a process within 
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a distributed architecture router to manage forwarding information in a manner that reduces the 
size of the forwarding table required at each routing node in a distributed architecture router. 
[0012] Yet another object of the present invention is to provide a router and a process to 
manage forwarding information for each routing node in a distributed router in which the routing 
node shares in real time its collected routing information with the other routing nodes. 
[0013] Still yet another object of the present invention is to provide a router and a process to 
manage forwarding information by using a binary aggregation tree in each routing node, with the 
aggregation tree being built with nodes corresponding to routing information and delegation nodes 
that aggregate the routing information, in a distributed router. 

[0014] A further object of the present invention is to provide a router and a process to 
efficiently manage forwarding information by variably setting the aggregation level of delegation 
nodes. 

[0015] In accordance with an embodiment of the present invention, in a distributed architecture 
router and process for managing forwarding information in the distributed router, all routing nodes 
share a routing table that includes routing information collected by each of those routing nodes 
and an aggregation tree created on the basis of the routing table. When new routing information 
is inserted into the routing table, a position in the aggregation tree is detected at which an insertion 
node corresponding to the new routing information is to be inserted into the aggregation tree. The 
aggregation tree is searched to locate an ancestor node of the insertion node at, or below, a 
predetermined maximum aggregation level. Given the presence of the ancestor node, the 
forwarding table is left un-updated with information about the insertion node when both 
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forwarding information corresponding to the ancestor node is in the forwarding table with the 
ancestor node and the insertion node and the ancestor node were generated from the same source 
area. In the absence of the ancestor node, the aggregation level is reset to a level less than or equal 
to the maximum aggregation level, and a delegation node representative of the insertion node is 
inserted at the reset aggregation level. The source area of the inserted routing information is 
determined. If the source area of the routing information is a virtual area, forwarding information 
corresponding to the delegation node is inserted in the forwarding table. If the source area of the 
routing information is a local area, forwarding information corresponding to the insertion node 
is inserted into the forwarding table. 

[0016] In accordance with another embodiment of the present invention, in a distributed router 
and a process to manage forwarding information in the distributed router in which all routing 
nodes share a routing table including routing information collected by each of the routing nodes 
and an aggregation tree created on the basis of the routing table. When routing information is 
deleted from the routing table, a deletion node corresponding to the deleted routing information 
is located in the aggregation tree. If forwarding information corresponding to the deletion node 
is in the forwarding table, the aggregation tree is searched to locate a descendant node of the 
deletion node at or below a predetermined maximum aggregation level. When a descendant node 
exists for the deletion node, the descendant node is set as a new source node of a delegation node. 
When no descendant nodes exist for the deletion node, forwarding information corresponding to 
the deletion node is deleted from the forwarding table. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0017] A more complete appreciation of the invention, and many of the attendant advantages 
thereof, will be readily apparent as the same becomes better understood by reference to the 
following detailed description when considered in conjunction with the accompanying drawings 
in which like reference symbols indicate the same or similar components, wherein: 
[0018] FIG. 1 is a schematic block diagram that illustrates the configuration of an exemplary 
distributed router; 

[0019] FIG. 2 is a schematic block diagram illustrating a typical process structure incorporated 
into a distributed router; 

[0020] FIG. 3 is a schematic block diagram illustrating a process structure in a distributed router 
constructed as an embodiment of the present invention; 

[0021] FIG. 4A illustrates the format of the management data about each node in an aggregation 
tree created to manage entries of forwarding information in an embodiment of the present 
invention; 

[0022] FIG. 4B illustrates an aggregation tree created to manage entries of forwarding 
information in an embodiment of the present invention; 

[0023] FIG. 4C is a two coordinate graph illustrating a prefix distribution as a function of the 
length of a prefix; 

[0024] FIG. 5 is a flowchart illustrating a method for managing added routing information 
according to the principles of the present invention; 

[0025] FIGs. 6A, 6B and 6C are flowcharts illustrating a method for adding entries of 
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forwarding information according to the principles of the present invention; 

[0026] FIG. 7 is a flowchart illustrating a method for managing deleted routing information 

according to the principles of the present invention; 

[0027] FIGs. 8 A to 8G collectively illustrate an algorithm for dynamically managing entries of 
forwarding information according to the principles of the present invention; 
[0028] FIGs. 9A and 9B are diagrams illustrating a method for managing added entries of 
forwarding information in an embodiment of the present invention; 

[0029] FIGs. 10A and 10B are diagrams illustrating a method of managing deletion of 
forwarding information in an embodiment of the present invention; and 

[0030] FIGs. 1 1 A is a table and FIGs. 1 IB to 1 ID are two coordinate graphs that illustrate test 
results which verify the effects of managing dynamic forwarding information according to the 
principles of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
[0031] Exemplars of current practice and preferred embodiments of the present invention will 
be described herein below with reference to the accompanying drawings. In the following 
description, well-known functions or constructions are not described in detail since they would 
obscure the invention in unnecessary detail. 

[0032] FIG. 1 is a schematic block diagram of an exemplary router 100 having a distributed 
architecture. The distributed router illustrated in FIG. 1 may be a Galaxy Internet protocol (i.e., 
an IP router). 
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[0033] Referring to FIG. 1, the distributed architecture of router 100 provides a plurality of 
routing nodes 110,120,130 and 1 40 connected to each other through a switching module (S WM) 
150. Each of the routing nodes 110, 120, 130, 140 is provided with an input/output processor 
(IOP) 111. Each input/output processor 1 1 1 is designed to receive packets from two physical 
medium devices (PMDs: PMD-1 and PMD-2), respectively 112 and 113. 
[0034] These routing nodes RNs 1 10, 120, 130, 140 each has its own routing tables to support 
their sub-networks and each has its own processors to process routing paths. Routing nodes RNs 
1 10 , 120, 130, 140 each run the routing protocols and perform forwarding, independently. From 
the perspective of users, routing nodes RNs 1 10-140 are seen as one router. Thus, routing nodes 
RNs 1 1 0, 1 20, 1 30, 1 40 each manage the routing tables of the other routing nodes 1 1 0, 1 20, 1 30, 
140, globally. A physical sub-network connected to any one of the routing nodes RNs 1 10, 120, 
130, 140 is called a local area B, and a network formed by the connections between the routing 
nodes RNs 1 10, 120, 130, 140 via switching module SWM 150 is called a virtual area A. 
[0035] FIG. 2 is a schematic block diagram illustrating a typical process structure for a 
distributed router 1 00, especially illustrating the process performed by input/output processors IOP 
10, 20, 30, 40 in each routing node RN and the connections between switching module SWM 50 
and IOPs 10, 20, 30, 40 (IOP#l, IOP#2, IOP#3 and IOP#4) in the case where distributed router 
100 is equipped with four routing nodes RNs. 

[0036] Continuing to refer to FIG. 2, IOP#l includes a plurality of routing protocols, such as 
ripd 1 1, ospfd 12, bgpd 13 and isisd 14, an IOP management processor, Galaxy Loosely Unified 
Environment Daemon (/. e. , GLUED) 1 5 that serves as an input and output management processor, 
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a routing table 16, and a forwarding table 17. 

[0037] Routing protocols 11, 12, 13, 14 collect routing information based on their unique 
collection criteria. Routing table 1 6 stores the collected routing information, and forwarding table 
1 7 stores forwarding information obtained from calculating the stored routing information. 
[0038] Management processor 15 of IOP#l is responsible for storing the collected routing 
information in routing table 16 and the forwarding information in forwarding table 17, and 
managing routing table 1 6 and forwarding table 1 7. Management processor 1 5 also advertises the 
collected routing information stored by routing table 1 6 to the other input/output processors IOPs 
20, 30 and 40 via switching module SWM 50. 

[0039] IOP#l is divided into a system processor area 60 with the routing protocols 1 1 , 12, 13, 
14, IOP management processor 15, and routing table 16, and a network processor area 70 with 
forwarding table 17. System processor area 60 performs a set of operations for collecting the 
routing information, managing the forwarding table assembled by calculating a routing path, and 
sharing the routing table with the other input/output processors IOPs 20, 30 and 40, whereas 
network processor area 70 performs forwarding work between network equipment connected in 
the local area according to the information stored in forwarding table 17. Thus, a distributed 
router, that is, a router constructed with a distributed architecture, can theoretically process a large 
volume of data more rapidly. 

[0040] As illustrated in FIGs. 1 and 2, each routing node RN 10, 20, 30, 40 must share its 
forwarding table with the other routing nodes RNs 10,20 3 0, 40 in order to process a large volume 
of data rapidly in distributed router 100. For this purpose, traditionally, each of the routing nodes 
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RN 1 0 5 20, 30, 40 exchanges the forwarding tables with the other routing nodes RNs via switching 
module SWM 50 so that each of the routing nodes can globally manage the forwarding tables of 
all of routing nodes 10, 20, 30, 40. On the assumption that a distributed router 100 includes ten 
routing nodes and that each of the routing nodes has ten thousand forwarding entries, each of the 
routing nodes must manage one hundred thousand forwarding entries. This concomitantly 
necessitates a large-capacity memory: 

#Memory capacity = 10,000 forwarding entries per routing node • 10 routing nodes. (1) 
in order to store the forwarding tables containing in excess of one hundred thousand forwarding 
entries; we have found the need for memory capacity to create an unnecessarily large overhead for 
packet forwarding transmission. 

[0041] FIG. 3 illustrates a process structure in a distributed router constructed as an 
embodiment of the present invention. In general, the distributed router typically has a plurality of 
input and output processors, referred to as IOPs such as IOP #1 . The IOPs exchange information 
with one another via a single switch module, SWM 250. This architecture is simplified to illustrate 
only one IOP 210 (IOP#l) and a SWM 250 in the representation provided by FIG. 3, for 
conciseness, although other routing nodes 220 (IOP#2), 230 (IOP#3) and 240 (IOP#3) are 
contemplated. 

[0042] Referring again to FIG. 3, system processor area 260 is a virtual private network (i.e., 
a "VPN"). The process structure of the distributed router constructed as one of the several 
possible embodiments of the present invention may include an aggregation tree 2 1 8 in the system 
processor area 260 of IOP#l. Aggregation tree 218 is built with nodes corresponding to 

Page 10 of 36 



PATENT 
P57009 

forwarding information and routing information managed by each input and output processor IOP 
in the distributed router and delegation nodes that aggregate the forwarding and routing 
information, as disclosed in Korea Patent Application No. 2002-0075701 entitled DYNAMIC 
MANAGEMENT METHOD FOR FORWARDING INFORMATION IN ROUTER HAVING 
DISTRIBUTED ARCHITECTURE, and filed by the same applicant of this application and 
subsequently filed in the United States Patent & Trademark Office on the 1 st day of December 
2003 and there assigned Serial No. 10/724,085, which application is incorporated herein. 
[0043] U.S. Serial No. 10/724,085 describes a method for reducing the sizes of a forwarding 
tables managed by each routing node of a router constructed with a distributed architecture; a 
technique to reduce internal traffic by reducing transmission of control packets that are transmitted 
in order to update a forwarding table in a router constructed with a distributed architecture; and 
a process for dynamically managing forwarding information in response to an addition or a 
deletion of routing information in a router having a distributed architecture, by aggregating or 
disaggregating forwarding information. 

[0044] As described by U.S. Serial No. 10/724,085 forwarding information may be managed 
in a router constructed with a distributed architecture including a plurality of routing nodes, by 
forming an aggregation tree corresponding to each routing node, with the aggregation tree 
including nodes corresponding to forwarding information for each of the routing nodes and virtual 
nodes for aggregating forwarding information for each of the routing nodes; varying the 
aggregation tree when forwarding information is added to each of the routing nodes; identifying 
the creation area of forwarding information added to each of the routing nodes; making an analysis 
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of the aggregation tree, advertising forwarding information to other routing nodes based on the 
analysis, and storing forwarding information in a local forwarding table of a corresponding routing 
node when the forwarding information is created in a local area of the corresponding routing node; 
and making an analysis of the aggregation tree, and storing forwarding information in the local 
forwarding table of the corresponding routing node based on the analysis when forwarding 
information is not created in the local area of the corresponding routing node. 
[0045] U.S. Serial No. 10/724,085 teaches that forwarding information may also be managed 
in a router constructed with a distributed architecture including a plurality of routing nodes, by 
forming an aggregation tree corresponding to each routing node, with the aggregation tree 
including nodes corresponding to forwarding information for each of the routing nodes and virtual 
nodes for aggregating forwarding information of each of the routing nodes; making an analysis 
of the aggregation tree of each of the routing nodes in response to a deletion of forwarding 
information in each routing node and identifying the creation area of deleted forwarding 
information; advertising the deletion of forwarding information to other routing nodes only when 
the deleted forwarding information is advertised to other routing nodes by analyzing the 
aggregation tree when deleted forwarding information is created in a local area of the 
corresponding routing node, deleting the node corresponding to deleted forwarding information 
from the aggregation tree, and deleting forwarding information from a local forwarding table of 
the corresponding routing node; and deleting the node corresponding to forwarding information 
from the aggregation tree when deleted forwarding information is not created in the local area of 
the corresponding routing node. 
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[0046] Switch module SWM 250 is provided with routing protocols ripd 25 1 , ospfd 252, bgpd 

253 and Dglued 254. Internal peer connections are made between these routing protocols 251 to 

254 and their counterparts, ripd 211, ospfd 2 1 2, bgpd 2 1 3 and glued 2 1 4 in input/output processor 
IOP#l. 

[0047] Accordingly, switch module SWM 250 shares in real time routing information collected 
by the respective routing protocols of each input/output processor IOP with IOP#l and provides 
the routing information to the IOPs of the other routing nodes via the internal peer connections. 
Consequently, in a distributed router constructed according to the principles of the present 
invention, the internal peer connections between the routing protocols make it possible to share 
the same routing information among all input and output processors IOPs. 
[0048] In the embodiment illustrated by FIG. 3 , routing table manager modules RTMs 2 1 5 and 
255, respectively included in IOP#l and switch module SWM 250 globally manage routing 
information obtained from the routing protocols 2 1 1 , 2 1 2, 2 1 3 , 2 1 4, and the routing protocols 251, 
252, 253, 254, and manage the priority levels of the routing information. 
[0049] FIG. 4A illustrates the format of the management data about each node in an aggregation 
tree created to manage forwarding information according to an embodiment of the present 
invention. Referring to FIG. 4A, the management data of each node includes a PREFIX that is an 
address to which forwarding information is to be forwarded, a LENGTH that states the length of 
the PREFIX, an Aggregation_Level that indicates the aggregation level of the node, an INDEX 
indicating whether the node is a delegation node or is a source node to which the delegation node 
belongs (e.g., a node that has created the delegation node), a TYPE that indicates the type of the 
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forwarding information, a SOURCE IOP that indicates the routing node RN that generated the 
forwarding information, a FT FLAG that indicates whether the forwarding information has been 
stored in a local forwarding table, and general link information in the binary tree, for example, 
PARENT is an indicator that identifies a parent node, LJSUBTREE is a data field indicating a left 
subtree, and R_SUBTREE is a data field indicating a right subtree. 

[0050] The aggregation level is initially set to a default level (i.e., a maximum level) by an 
operator. It is variable to at or below the default level, depending on the router implementation. 
That is, the aggregation level can be reset dynamically according to the network condition so that 
a delegation node for aggregating routing information can be created at or below the dynamic 
level. 

[0051] INDEX indicates, in the case of a delegation node, the source node that created the 
delegation node. INDEX provides the information by which the source node can be searched for 
from the delegation node. For example, if a delegation node is derived from the right child node 
under the left child node of the delegation node, INDEX for the delegation node is "01" since 
generally, a left child node is "0" and a right child node is "1". 

[0052] TYPE indicates the type of the routing protocol (e.g., BGP, SDPF, RIP, etc.) by which 
the forwarding information is generated in an input and output processor IOP 210. For a 
delegation node, TYPE is set to indicate delegation such that the forwarding information for the 
delegation node is distinguished from actual forwarding information. The delegation type is lower 
in priority level than any other type (i.e. , BGF, SDPF, RIP, etc.). Since a delegation node provides 
virtual forwarding information, actual forwarding information generated by the routing protocols 
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is of higher priority. 

[0053] To set the type of forwarding information, a routing node determines the source area in 
which the forwarding information was generated. If it was generated from a local area, the routing 
node RN sets the type of the forwarding information according to the type of the processor that 
created the forwarding information. On the other hand, if the forwarding information was 
generated from a virtual area, the routing node RN sets the type of the forwarding information in 
a manner that indicates that the forwarding information is virtual. To do so, the routing node RN 
analyzes the PREFIX of the forwarding information. If the PREFIX is a private Internet Protocol 
{i.e., an IP) address, the routing node RN considers that the forwarding information is from the 
virtual area. Otherwise, the routing node RN considers that the forwarding information is from the 
local area. 

[0054] A private IP address refers to an address that is available in a local network, identifying 
a node within the local network. Therefore, a private IP address is unavailable from a source that 
is outside the local network. A distributed router generally assigns a private IP address to each 
routing node in order to identify the routing nodes. Therefore, in the practice of the present 
invention, the source area of the forwarding information is identified by use of a private IP address 
for each of the routing nodes. 

[0055] FIG. 4B illustrates an example of an aggregation tree created to manage forwarding 
information in the practice of one embodiment of the present invention. The aggregation tree is 
a binary tree. The updates of the aggregation tree due to insertion and deletion of routing 
information will be described in detail later, with reference to FIGs. 9A through 10B. 
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[0056] Turning now to FIG. 4C, routing entries in a real border gateway protocol (/. e. , a "BGP") 
core routing table, which is used to verify the performance of the present invention, are 
concentrated at prefix length of between 1 5 to 24 units, as shown in FIG. 4C. The analysis of this 
prefix length distribution reveals that the algorithm overhead involved in dynamic aggregation and 
retrieval of forwarding information can be reduced by limiting the aggregation level of a 
delegation node to the default level. 

[0057] In accordance with the present invention, when the Galaxy IP router illustrated in FIG. 
1 is extended to a multi-rack configuration, the routing table manager (i. e. , RTM) 255 of switching 
module SWM 250 in each rack manages the routing tables of all input/output processors (i.e., 
IOPs) under its management; this enables forwarding information aggregation between IOPs to 
be easily expanded to the level of forwarding information aggregation between racks. 
[0058] FIG. 5 is a flowchart illustrating a method for managing added routing information in 
an embodiment of the present invention. 

[0059] Referring to FIG. 5, if during step 1 1 00, new routing information is generated and added 
to the routing table in a routing node RN in the distributed router configured as illustrated in FIG. 
3, during step 1200 routing node RN detects the position of an insertion node corresponding to 
the added routing information (hereinafter, the node corresponding to the added routing 
information will be referred to as an insertion node). Specifically, a binary search of the 
aggregation tree from a root node is repeated until a node is detected that has a prefix of the same 
length as that of the added routing information. When the position of the insertion node is 
detected, then during step 1 300 routing node RN determines whether a delegation node exists in 
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the position of the insertion node. If step 1300 determines that no delegation node exists at the 
position of the insertion node, that is, if step 1 300 finds that the position is empty then during step 
2000 the insertion node corresponding to the added routing information is inserted at the position. 
[0060] If during step 1300, the presence of a delegation node is detected at the position of the 
insertion node, the forwarding information corresponding to the delegation node is deleted in step 
1600 to instead permit an insertion of the insertion node in step 2000. 

[0061] For this purpose, during step 1400 routing node RN determines whether there is a 
left/right subtree for the delegation node. If the delegation node does not have a left/right subtree, 
in step 1700 the routing node RN deletes the forwarding information corresponding to the 
delegation node from its forwarding table. If during step 1400 the delegation node is found to have 
a left/right subtree, the nodes at the left/right subtree must be reinserted in step 1500 before the 
forwarding information corresponding to the delegation node is deleted in step 1600, since the 
delegation node is a representative of the nodes at the left/right subtree. After an insertion of the 
nodes at the left/right subtree in step 1500, the whole insertion procedure of FIG. 5 is performed 
again. This is typically termed a recursive function. That is, in the presence of the left/right 
subtree, a reinsertion of a left/right subtree is performed in step 1500 and then in step 1600 the 
forwarding information corresponding to the delegation node is deleted from the forwarding table. 
[0062] As described above, when the delegation node exists at the position of the insertion 
node, the forwarding information corresponding to the delegation node is replaced by the insertion 
node in steps 1400 through 1700. 

[0063] FIGs. 6A, 6B an 6C illustrate insertion step 2000 in more detail. 
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[0064] Referring to FIG. 6A, before routing node RN inserts the forwarding information 
corresponding to the insertion node, during step 2001 the routing node searches for an ancestor 
node of the insertion node at or below the default level of the insertion node in order to detect a 
position at which to insert a delegation node representative of the insertion node. 
[0065] If step 2003 fails to detect an ancestor node, a default search level is set in step 2005, 
by Equation (2) as illustrated by the algorithm set forth in Fig. 8C: 

Search Levd(search/evef) = (defaultlevel'2) - 1 (2) 

In step 2007, routing node RN determines whether an ancestor node of the insertion node exists 
at or below the search level established in step 2007 in order to reduce the occurrence of errors 
when inserting a delegation node for the insertion node. 

[0066] If step 2007 establishes that there is no ancestor node of the insertion node at or below 
the search level established in step 2005, then in step 21 70, the delegation node representative of 
the insertion node for the new routing information being inserted into the routing table, is inserted 
at the default level. If an ancestor node of the insertion node is detected during step 2007 at or 
below the search level, in step 2009 a search is made for descendant nodes of the ancestor node 
within the default level, that is at or below the default for the search level established in step 2005 
in order to determine the presence or absence of descendant nodes for which the delegation node 
is the representative. 

[0067] In the absence of any descendant node at or below the default search level, the 
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delegation node for the insertion node is inserted at the default search level in step 2170. In the 
presence of a descendant node however, the aggregation level is reset as a dynamic level in step 
2 1 30 and in step 2 1 50 the delegation node is inserted at the dynamic level of the aggregation level 
established by step 2130. The aggregation level is related to the tree level; by way of example, 
with reference to Fig. 4B, the aggregation level between node #9 and node #2 is two. Preferably, 
the dynamic level is set as shown in Fig. 8C, by Equation (3) as: 

dynamiclevel = GetNodePrefixLength (insertion node) 

- GetDistPrefixLength (insertionnode, descendant node) (3) 

where: 

GetNodePrefixLength is a function for computing the prefix length 
of the insertion node, and 

GetDistPrefixLength is a function for computing a position when 
the prefix lengths of the insertion node and the descendant node 
differ. 

For example, if the prefix length of the insertion node is 1 8 and the prefix length of the descendant 
node is different at 19, the dynamic level is one, (that is, 1 = 19 - 18) according to Equation (3)). 
Thus, the delegation node is generated at a level higher than the insertion node by one level. 
[0068] After the insertion of the delegation node in steps 2005 through 2 1 70, in step 2 1 90 the 
routing node RN determines the source area of the routing information that is being inserted in 
order to determine whether to store the added routing information in the forwarding table or not. 
If step 2190 determines that the routing information is from the virtual area, the forwarding 
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information corresponding to the delegation node for the routing information is inserted in the 
forwarding table in step 2210. If step 2190 determines that the routing information is from the 
local area however, the forwarding information corresponding to the insertion node for the routing 
information is inserted in the forwarding table in step 2230. 

[0069] FIG. 6B illustrates an operation performed after steps 2001, 2003 determine that there 
is an ancestor node for the insertion node of the insertion node. 

[0070] Referring to FIGs. 6A, 6B and 6C collectively, upon detection during step 2003 of an 
ancestor node of the insertion node, a determination is made by the SelectDelegationLevel 
algorithm illustrated by Fig. 6C in step 2300 to establish a dynamic level at which to insert the 
delegation node. The SelectDelegationLevel algorithm sets the delegation level to - 1 through steps 
2350, 2360, 2370 to reset the dynamic level in order to omit a forwarding table update, if the 
forwarding table has already been updated with the ancestor node of the insertion node and both 
the insertion node and the ancestor node were generated from the same source IOP. 
[0071] The dynamic level is compared with zero in step 241 0. A dynamic level of zero implies 
that a delegation node representative for the insertion node can not be inserted into the aggregation 
tree, and the forwarding information corresponding to the insertion node is directly inserted in the 
forwarding table in step 2510. 

[0072] If the dynamic level is determined in step 2410 to be less than zero, the source area of 
the routing information is determined again in step 2530 and the forwarding table is updated in 
step 2550 with the forwarding information corresponding to the insertion node only if the source 
area of the routing information is determined in step 2530 to be the local area. If the routing 
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information is determined by step 2530 to be from the virtual area, the routing node RN jumps to 
the next step, omitting the forwarding table update. In this case, the aggregation process exerts an 
effect that advantageously tends to reduce the memory overhead that would be otherwise incurred 
by the forwarding tables. 

[0073] If the dynamic level is determined in step 24 1 0 to be greater than zero, the routing node 
RN inserts the delegation node at the dynamic level in step 2430. The routing node RN then 
determines the source area of the routing information in step 2450. If the source area is found in 
step 2450 to be the local area in step 2470, the routing node RN inserts the forwarding 
information corresponding to the delegation node into the forwarding table. If the source area is 
found during the local area however, the routing node RN inserts the forwarding information 
corresponding to the insertion node in the forwarding table in step 2490. 
[0074] FIG. 6C illustrates the algorithm for step 2300 in more detail. To select the dynamic 
level at which to insert the delegation node, the aggregation level is reset in dependence upon 
whether step 2310 detects the presence or absence of a descendant node of the insertion node. In 
step 2320, a search is made for a descendant node of the insertion node. If step 2320 determines 
that a descendant node of the insertion node was detected in step 23 1 0, the dynamic level, that is, 
the aggregation level is reset in step 2330 by Equation (3) using the prefix length of the insertion 
node and the position where the insertion node and the descendant node differ in prefix length. 
On the other hand, in the absence of the detection of a descendant node in step 2320, the 
delegation level for the ancestor node of the insertion node is set in step 2340 at the aggregation 
level of the delegation node. 
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[0075] Meanwhile, if during step 2350 the ancestor node of the insertion node is determined 
to exist in the aggregation tree if in step 2360, and if the insertion node and the ancestor node are 
also determined to have been generated from the same source IOP, then in step 2370 the dynamic 
level is set to -1 in order to omit the forwarding table updating step. 

[0076] FIG. 7 is a flowchart illustrating a method for managing deleted routing information 
according to an embodiment of the present invention. 

[0077] Referring to FIG. 7, in step 5 1 00, when routing information is deleted from the routing 
table of an routing node RN, the routing table manager RNB locates a node corresponding to the 
deleted routing information (hereinafter, referred to as a deletion node) in step 5200. This step is 
similar to the search for the position of the insertion node performed when making an insertion 
of routing information. That is, in step 5200 a binary search in the aggregation tree from a root 
node is repeated until a node is located that has a prefix length equal to that of the deleted routing 
information. 

[0078] Upon detection of the deletion node, in step 5300 the routing node RN determines 
whether, or not, the deletion node is the source node of a delegation node. If the deletion node is 
the source node, the forwarding information corresponding to the delegation node is changed to 
that of the deletion node in step 5400 in order to effect the deletion of the deletion node by 
deleting the delegation node. 

[0079] In step 5500, the routing node RN determines whether the forwarding information 
corresponding to the deletion node is in the forwarding table. If it is not, the deletion procedure 
ends. On the other hand, if the forwarding information corresponding to the deletion node is 
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present in the forwarding table, a descendant node for the deletion node is searched for in step 
5600 at or below the default level. If a descendant node is detected during step 5600, the 
descendant node is set as a new source node of the delegation node in step 5800, which might 
otherwise lead to the loss of a delegation node for the other descendant nodes when the delegation 
node represents a plurality of descendant nodes and one of those descendant nodes which is the 
source node of the delegation node is deleted. 

[0080] In the absence of the detection during steps 5600, 5700 a descendant node of the deletion 
node at or below the default level in step 5900, the routing node RN deletes the forwarding 
information corresponding to deletion node from the forwarding table. 

[0081] FIGs. 8A to 8G illustrate an algorithm for dynamically managing forwarding information 
according to an embodiment of the present invention. 

[0082] FIG. 8A illustrates a pseudo code representation of the steps 1 100, 1200, 1300, 1400, 
1500, 1600 and 1700 illustrated in FIG. 5. FIG. 8B illustrates a pseudo code representation of step 
1200 illustrated in FIG. 5 and step 5200 illustrated in FIG. 7. FIG. 8C illustrates a pseudo code 
representation of steps 2001 through 2210 and 2230 illustrated in FIG. 6 A. FIG. 8D illustrates a 
pseudo code representation of steps 2150 and 2170 illustrated in FIG. 6 A. FIG. 8E illustrates a 
pseudo code representation of steps 2300, 2410, 2430, 2450, 2470, 2490, 2510, 2530 and 2550 
illustrated in FIG. 6B. FIG. 8F illustrates a pseudo code representation of steps 2300 through 2370 
illustrated in FIG. 6C. FIG. 8G illustrates a pseudo code representation of steps 5100 through 
5900 illustrated in FIG. 7. Since those steps in FIGs. 8A to 8G have been described in detail 
above, their description is not repeated here. The algorithm presented in the pseudo code shown 
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by FIGs. 8 A to 8G is a merely exemplary application. Thus, many modifications may be made to 
the algorithm, in the practice of the principles of this invention. 

[0083] FIGs. 9A to 10B are diagrams illustratively showing the forwarding information 
managing techniques, and especially the method of managing added and deleted forwarding 
information under a default level of two, in accordance with the principles of the present 
invention. Specifically, FIGs. 9A and 9B illustratively show the management of added forwarding 
information, and FIGs. 10A and 10B illustratively show the management of deleted forwarding 
information. 

[0084] In aggregation trees illustrated in FIGs. 9A to 10B, PREFIX provides an address to 
which the forwarding information corresponding to a node is to be forwarded, by identifying a 
destination node. SOURCE IOP indicates the source IOP of the routing node that created the 
insertion node, and FE indicates whether the forwarding information has been stored in a 
forwarding table. FE, if marked, indicates the presence of the forwarding information in the 
forwarding table. INDEX indicates the source node of the node to be forwarded if the node to be 
forwarded is a delegation node. LEVEL is the aggregation level of the node to be forwarded. 
[0085] Referring to FIG. 9A, when new routing information with a forwarding Prefix of three 
is produced in an IOP 210 (IOP#l) with forwarding information stored in the Forwarding Table 
217, a controller of IOP#l inserts the routing information (i.e., node 3) in binary aggregation tree 
21 8 of IOP#l . Since the aggregation level of the insertion node is two, a delegation node with a 
prefix of zero is added two levels higher than the insertion node with a prefix of three. Since the 
source node of the delegation node with a prefix of zero is the insertion node 3 (that is, the 
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insertion node with a Prefix of "3"), INDEX for the delegation node is "00". Information about 
insertion node 3 is stored in a forwarding table because both the insertion node 3 and the 
delegation node with a prefix of zero have the same source, namely routing node 210 IOP #1 . 
[0086] Meanwhile, the other routing nodes share the routing information of IOP #1 (e.g. , that 
is, the other routing nodes IOP#2, IOP#3, IOP#4, share aggregation tree 218 of routing node 
IOP#l) in the nature of the distributed router of the present invention so that each node shares its 
routing information stored in its routing table with the other nodes. In the illustrated case of FIG. 
9A, an IOP 220 (IOP#2) shares the routing information stored in routing table 216 of IOP#l . The 
same will be applied to cases described hereinbelow. 

[0087] Referring again to FIG. 9A, although IOP#2 has the same aggregation tree as that of 
IOP#l, it has different forwarding table contents. That is, IOP#l stores information about 
insertion node 3 in its forwarding table 217 in accordance with step 2230 because insertion node 
3 is new routing information that was produced in the local area serviced by IOP#l, whereas 
IOP#2 stores information about delegation node 0 in accordance with step 2210 because 
delegation node 0 is new routing information was produced in the virtual area shared by IOP#l 
of routing node 210 and IOP#2 of routing node 220. 

[0088] FIG. 9B illustrates a case where routing information corresponding to with a prefix of 
seven is produced in the local area of IOP#2, with the delegation node 0 already stored in the 
forwarding table. 

[0089] A controller of IOP#2 detects the position of insertion node 7 and searches in accordance 
with step 2007 for an ancestor node for insertion node 7 according to the default aggregation level 
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of "2" established by step 2005. The controller of IOP#2 then detects a node 1 as the ancestor 
node of insertion node 7. Node 1 is an ancestor node through which the insertion node 3 of IOP#l 
is detected. Therefore, a delegation node for node 7 is inserted at node 4 which serves as the 
delegation node of insertion node 7 in accordance with step 2170, and not at ancestor node 1 . As 
described above, the aggregation level is variable and the aggregation level, when reset in step 
2130, is called a dynamic level in the present invention. 

[0090] As illustrated in FIG. 9B, both insertion node 7 and ancestor node 4 are added to the 
aggregation tree 218 of IOP#l, and the forwarding table of IOP#l is updated with the delegation 
node 4 of the node 7 because the source area of node 4 and node 7 were created by the virtual area 
shared by routing nodes 210, 220 (i.e., IOP#l, IOP#2). 

[0091] Meanwhile, the controller of IOP#2 updates its forwarding table with information about 
insertion node 7 because node 7 is from the local area serviced by routing node 220, that is, by 
IOP #2. 

[0092] A description will be made now of deletion of routing information according to the 
present invention with reference to FIGs. 10A and 10B. 

[0093] Referring to FIG. 10A, a delegation node 0 is representative of nodes 3, 4, 5 and 6 that 
were generated in the local area of IOP#l . If the source node of node 0 is node 3, information 
about nodes 3,4,5 and 6 is stored in the forwarding table of routing node 2 1 0, IOP#l , while only 
information about the node 0 is stored in the forwarding table of routing node 220, IOP#2. 
[0094] FIG. 10B illustrates deletion of node 3, which is the source node of delegation node 0, 
from the aggregation trees of routing trees 210, 220 illustrated in FIG. 10A. 
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[0095] In the case where the source node of a delegation node is deleted, the forwarding 
information corresponding to the deleted source node, that is, the forwarding information 
corresponding to the deletion node is deleted from the forwarding table, and the source node of 
the delegation node is changed, without any change in a virtual area in the present invention. 
[0096] As illustrated in FIG. 10B, if the node 3 is the source node of delegation node 0, and 
node 3 is deleted, the controller of IOP#l changes the source node of delegation node 0 to node 
4. Meanwhile, the controller of routing node 220, IOP#2 does not need to perform any particular 
operation on the forwarding table of routing node 220, because only information about delegation 
node 0 is stored in the forwarding table of routing node 220. 

[0097] FIGs. 1 1 A to 1 1 D illustrate test results that verify the effects of the dynamic forwarding 
information management according to the embodiment of the present invention. 
[0098] The test results were achieved from a test in which 53,000 routing entries were inserted 
and a predetermined proportion of the routing entries were flapped under the conditions of a 
Galaxy system constructed with one switching module SWM and two routing node IOPs and 
routing table entries in a core border gateway protocol router (/. e. , a "BGP" router) available from 
a site http://www.telstra.net/ops^gptable.html or http://bgp.potaro.net/ . 

[0099] FIG. 1 1 A illustrates the result of a test performed to determine whether the sequence of 
inserted forwarding entries affects the effects of the present invention. Sample entries arranged 
in an ascending order are inserted while the order of the sample entries is randomly changed ten 
times under six defaults levels. Referring to FIG. 13 A, the number of the forwarding entries is 
varied between 60 to 1 10. Accordingly, it is noted from the above test result that the aggregation 
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effect of the present invention is rarely affected by the insertion order of the forwarding entries. 
[0100] FIG. 1 IB is a graph illustrating overhead measurements under six default levels. From 
FIGs. 1 1 A and 1 IB, it is concluded that the present invention is most effective at or below a 
default level of 3, considering router performance and overhead. 

[0101] FIG. 11C is a graph illustrating the numbers of forwarding entries remaining in a 
forwarding table when between 0% to 70% of 53,000 core BGP routing entries are withdrawn. 
Referring to FIG. 1 1C, about 26% to 77% of the forwarding entries are reduced when the core 
BGP entries are simply inserted with a 0% deletion. 

[0102] FIG. 1 ID is a graph illustrating the performance of an actual Internet environment 
measured by use of an Agilent Router Tester. The Agilent Router Tester generally measures the 
performance of a router under a dynamic routing environment in which a network topology or 
network reachability continuously changes. The figure illustrates a convergence time as a function 
of the number of flap entries. The convergence time refers to time required for the router to reflect 
routing information changes in a forwarding table. This "BGP4 flap convergence time" test 
measures a traffic redirect convergence time defined as time required to replace a primary router 
with a new router when the primary router is dropped due to changes in the network topology or 
network reachability. The test was performed using three routing nodes RNs. Two of the three 
routing nodes RNs advertise the reachability of the same network behind the routing nodes RNs 
while the other routing node RN generates data traffic in the advertised network. From the 
convergence time measurements illustrated in FIG. 1 ID, the convergence time is reduced when 
only information about the source node of a delegation node is changed to minimize the 
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amendment of the forwarding table in deleting the actual source node of the delegation node. 
[0103] In accordance with the present invention as described above, each routing node RN 
shares its collected routing information in real time with the other routing nodes RNs and manages 
forwarding information dynamically based on the routing information in a distributed router, 
thereby obviating the need for packet forwarding to share the routing information between the 
routing nodes RNs. The routing information is selectively updated in forwarding tables. Thus, a 
forwarding table for each routing node RN is efficiently managed. Furthermore, the size of the 
forwarding table in each routing node RN can be reduced since the forwarding information of 
each routing node RN is managed in the form of a binary aggregation tree and the aggregation 
level of a delegation node that aggregates node information corresponding to routing information 
in the aggregation tree is variably set. 

[0104] While the invention has been shown and described with reference to certain preferred 
embodiments thereof, it will be understood by those skilled in the art that various changes in form 
and details may be made therein without departing from the spirit and scope of the invention as 
defined by the appended claims. 
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